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ABSTRACT 

A description is provided of the structure, contents, 
and potential uses of a National Storehouse of Educational Materials 
Successes, The Storehouse is depicted as being a collection of 
evidence relating to what works in education. Details are presented 
on its contents, its expected users, the functions it could serve, 
and its operational and organizational features. Six organizational 
models are discussed and an appendix is included which gives some 
selected examples of the Storehouse's components. (PB) 
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THE NATIONAL STOREHOUSE OF EDUCATIONAL MATERIALS/SUCCESSES 



The Problem 

Leading decision-makers concerned with the directions, structures and support 
bases of our American Society (of late being joined by more and more leaders within 
the educational ranks) claim that educators have littlei If any, Informed experienced- 
accumulated^^^ which to base decisions about anything that is important 
In education. Even the teaching profession, the group that should have the best first- 
hand knowledge about what works and what doesn't work. Is generally in favor of 
maintaining the status quo until more **exact evidence*^ about the educ-tional process 
Is available. Educational researchers are scrambling to prove that teaching does make 
a difference and that educators do know some things that are not well known to the 
average person on the street. 

In less than 200 years the educators of this nation have built what is probably 
the world's most democratic and effective educational system. Although the heavens 
and many other equally Inspiring forces ucre probably on the side of this 85 billion 
dollar, 60 million participant enterprise, it neither grew like topsy nor evolved with- 
out considerable attention to evidence and thoughtful decisions. Consequently it seems 
ludicrous to charge that today's educators have no evidence upon which to base program 
decisions. Because of the massive size of the educational enterprise, the continuity 
of its existence, and the unusual inriportance placed upon it by the citizens of this 
nation, it is probable that educators are steeped in more evidence about the nature of 
their trade than practitioners of any other single art, trade, or profession in the 
American social system. 

The purpose of this paper is not to rally opposition to the narrow "hard 
evidence'* (whatever that is) worshippers or the educational doom-sayers, but to begin 
i dialogue about how the profession can more systematically organize and use the 
O 1 sting National Storehouse of Educational Material s and Successes that has been 
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s^"*™ richly and fully built over the last 200 years. 
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SOME EXPECTED OUTCOMES 



Short Ranke r 

1* Clear statement of the problem, recommendations about how 
to deal with it, a prioritizing of the recommendations , a 
strategy to Implement the recommendations r and a determina- 
tion of the next steps to be taken i 

2. A first cut on the nature of the National Storehouse 

3. A beginning list of locations and persons engaged in major 
component development--with a brief description of their 
programs 

4. A beginning bibliography of publications relating to the 
building and using of the National Storehouse 

5. A first draft of a publication presenting the Storehouse 
case to leading educators 

6. A specific strategy for further exploring the Storehouse 
concept 



Long Range ; 
Primary 

1. Better definition of the levels of evidence/successes avail- 
able in the Storehouse 

2. Better knowledge of the availability of evidence/successes 
at these levels 

3* More systematic relationship between evidence and program/ 
policy decisions 

4. More systematic design for utilizing and adding to the Store- 
house 

5. Greater use of the National Storehouse 

6* Greater public awareness of the successes of American edu- 
cation 

7. A plan for more effective sharing of successes within parti- 
cular educational specialities, e.g. competency-based educa- 
tion 
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8* A plan for riore effective sharing of successes between parti- 
cular educational concepts i e.g, competency-based education 
and interaction analysis or competenoy-based education and 
teaching centers' 

9. A plan for more effective sharing of successes between teach- 
er education and other professions, e.^. coinpetency-based 
teacher education and competency-based dental education 

10. A plan for more effective sharing of successes between edu- 
cation and business and industry regarding similar systems i 
e.g* storage and retrieval of educational information and 
storage and retrieval of airlines information; human relations 
vis a vis the community in education and human relations vis 
a vis the community in urban planning 

lit A plan for more effective sharing of successes between edu- 
cation and business and industry regarding the relationship 
between their respective '^Storehouses" and policy decision- 
making 



Secondary 

1. More effective systems of storage and retrieval of validated 
products and processes 

2. More effective systems of validating products and processes 

3. Better understanding of R & D needs 

4. Lees duplication and overlap of R & D efforts 

5» More systematic relationship between theory and practice 

6. Development of levels of evidence regarding educational 
success 
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What It Is 

The National Storehcfuse is a collection of evidence materials, pro- 
grams, ideas, concepts arid practices — of what works in education 
today. The storehouse exists ♦ What does not exist is an organizational 
framework that could point \sp gaps in what we knew, stimulate efforts 
to close them up, and provide a typology that would embrace new, as -yet 
unthought of problems, The missing organizational frafl»ework would make 
the evidence easily accessible to users, and would provide information 
on validation. 

Who Is It For 

The National Storehouse would be a user or consumer-based index with 
entries classified by topics focused on use or intended users • It 
would therefore be indexed in terns of problems or tasks an educator 
must cope with in order to be effective: 

the practitioner identifies a teacher competency for which 
he wants to provide trainings so turns to the National Store- 
house for a search of what's available 

the policy-maker is charged with formulating a new piece of 
legislation and needs information about it (e.g., reading 
program) so turns to the National Storehouse for research 
evidence and a bank of knowledgeable people 
the high school teacher of English wants training in how to 
cope with student response to literature, enters the system 
seeking English, high school, student response- -and the level 
of evidence desired. The con^uter search would identify the 

O 

ERIC 



appropriate alternative materials relating to the piobleins 
as described 

the policy-maker- -a school board* interested in IwprovinR its 
elementary staff development program- -coiild enter the Store- 
house by idejxtifying sdiool personnel, teacher training, 
elementary school, in-service, in order to see if materials 
exist that address this question. 

In organizing the National Storehouse, therefore, we talk to the 

question, how will it assist 
teachers 

teacher educators 

legislators - national policy-makers 
researchers 
educational consumers 
educational administrators 
lay administrators 

What It Does 

The National Storehouse identifies what we have, and as an immediate 
outgrowth, identifies what we need. The National Storehouse, there- 
fore, shaped by need (or the consumer) identifies for the potential 
user the origins (theory, experience, hunch, invention) of the evi- 
dence; then explains its current state of development (idea, pilot 
test, programnatic test, experimental test), its target, its relevance 
to broad categories of problems (policy decisions, R§D programs, prac- 
tical application in teacher, trainiiig, and organization and admijiis- 
tration of schooling.) 

Organized so it can answer the question, *Vhat do we know aboutX?", 
and open-ended as well, the National Storehouse could classify evi- 
dence in two ways: 
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Ij by the categories of information a user thinks; 
2) different conceptions or catistgories of educational 
problems. This would peimt the user to entploy his/her 
own search strategy and also invite him to look at the 
items in a variety of different ways 
Such an index could be constructed logically > based on soffte kind of 
analysis of problem areas. In a word, the system should be developed 
deductively from what a consensus of practitioners and laymen say we 
need, not inductively from what we know we have- -although the latter 
would also be included* 

Retrieval and Dissemination 

A user- or needs -oriented National Storehouse must assure easy access 
to practiticmers and policy-makers. 

The first step toward easy retrieval might be the organization of the 
index of storehouse materials into a simple directory* Contents 
might be divided into: (1) printed materials, (2) audio-visual 
materials, (3) ideas, (4) people and places. Listings should be short: 
product, contact name and address, one -line sumiary, extent of valida- 
tion, cost. The directory should be set up as a loose-leaf binder so 
that pages may be printed and distributed for insert. It should also 
be free- -or the cost should be nominal, covering only mailing expenses* 
Obviously, then, the directory must be funded by Federal or foundation 
monies. This foundation or Federal grant should be large enough to 
permit some subsidization of the producers of the items listed in the 
catalogue while producers seek ways to bring dcwn production costs. 
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iJiiloss nuitorlals costs are broght dcfwn, the easy access suggested 
above for practitioners Vtill not be accomplished. 

But to get that directory into the hands of the practitioners will 
require a major dissemination program., Such a program should be 
mounted by a communications expert ^^^o is professionally conpetent to 
utilize all media approaches to the problem. Such approaches would 
include such standard methods as direct mail notifications to local 
and state education agencies, associations and unions, to teacher 
centers, to the various national, state and local professional edira- 
tion associations. But the dissemination program should go much 
further. Exposure should mainly involve public service time and space 
in the education press (national, stAte and local); the educatiw trade 
aand professional press; local, close-circuit and cable radio and tele- 



vision; local and state conferences; displ at national conferences 
and so on* 



education is probably the greatest in the world • And wjch of what has 
been learned about the way to do things better is available for educa- 
tional program planners. To find out more abait these rich resources 
write to: The National Storehouse, Box XXX, Washington, D.C* 

Costs for such a program should be explored. A follw-up to (but also 
simultaneous with) the dissCTiination program might be the use of trained 
leaders who could go out on request to vork with local teachers on use 
of the materials and methods. The cormunications expert could make 
suggest ic»is on how best to coordinate this. But unless state and local 




The message should be siinple: The diversity and experience of American 
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cducation agencies- -or a foundation- -can underwrite such a program, 
costs might well be prohibitive* 

Quality Control 

But a mechanism must be developed to infom users about the quality of 
the evidence. 

Evidence should be thought of as a device for either hypothesis -testing 
or decision-makings Evaluation criteria differ depending on vAich of 
these tKo purposes the evidence is to serve. Evidence is generally 
"harder" for hypothesis- testing than for decision-making, although 
this may account for bad decision-making. 

The second factor determining the quality of evidence is the stage of 
development of the idea, program, or product* Different evidence is 
expected for a product in its earlier stages than in its "finished" 
stages. Thirdly, things that work- -hard evidence- -within the context 
of an integrated and sequenced program may not work when taken out of 
that context. 

Rather than searching for "hard" evidence, the functions of rating 
might better be ser\^ed by classifying items according to where they 
are in a sequence of steps in the R^D process instead of rating them. 
The sequence might run from armchair id^as, entirely untested, through 
ones tried out in laboratory experiments, in simulation or microteaching 
settings, to those field tested and ready for dissemination. It should 
be possible to define a set quite objectively; and where a piece of 
evidence lies in this sequence should be at least as useful to know as 



hw it was rated by somebody. If this kind of rating system were 
employed, it would be possible to enter the storehouse asking for 
the level of development (e.g., how much the storehouse had in that 
subject at a particular moment that had been thorouglily field tested.) 
A display could be called for \<hich would show such a quality control 
process by area, and it ^;ould be easy to see where weaknesses and 
Strengths lay--a iLscful tool forplaiming, for coinniunicating with 
legislators, etc. 

How To Organize It 

A number of models have been proposed, and they are by no means 
mutually exclusive: 

Model A 

I. Develop infoiriation sources: 

1. Gather available materials (including ideas) under four broad 
headings: (a) teaching skill or performance ; (b) curriculum 
materials and design by intended outcomes; (c) training of educa- 
tional personnel; (d) organization of instruction and schooling. 

2. Prepare for each item a developmcat history- -who developed the 
product or idea, its theoretical or other sources; its use; its 
current status. 

3. Classify each item by the criterion of its effectiveness the 
user has selected and by other criteria to which it might be 
relevant . 

4. Gather evidence from the developer and other users about 
evidence relative to effectiveness with respect to the criteria. 

5. Sort items by their relevance to policy, R^D, or practice. 



Model A Continued 
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11 • Develop the tagging system so anyone who want to search the 
eye tern can do ^oS 

1. Invito groups of potential usors to ask questions of the 
system. 

2« Tag items by questions, 

3t Identify unanswerable questions 

4. Determine whether tJie question is unanswerable because of 
the classification system or because there is no information 
in the system 

III. Develop validation of system: 

1. ' Invite conceptualizers of problems to ask questions of the s> s- 
tem (e.g., Jencks asks the system for information on school effect- 
iveness j Coleman asks tlie system for information on the effects 

of desegregation) 

2, Invite a group of people to see if they can ''break'* the system 
(e.g., ask it questions it cannot ansv/er. 

Ultimately evidence mir?it be categorized by eventual goal and stage 
of development: 
Goal: 



Produce 
Significant 
Study 
Gains 



USK 



IDIiA 



FIRST 
DVLPMf. 



TliST 



FIliLD 
TEST 
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f. Develop use-user categories; 



Primary User 



Prijnary Use 



Teacher Trainers 
Teacher Trainers 
Decision-Makers 
Decision^Makers , 
Researchers 



Teachers 



Evaluators 
General Public 



Education of Children at Various Levels 

Ihre- Service Teacher Education 

In-Service Teacher Education 

Educational Decision Making at Various Levels 

Policy Decision Making at Various Levels 

Heuristics 

Mission Research 

Synthesis 



Each Ifee or User category would generate its own discrete, though per- 
haps overlapping, set of categories designed to make sense to those 
interested in it for that purpose (e.g., DISTAR might have high interest 
for elementary teachers, moderate interest for teacher trainers, little 
interest for decision-makers, no interest for heuristic researchers, 
moderate interest for mission researchers, and be of great interest for 
synthesizers, and dissemination to the general public. 
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Model B Continued 

lit Consider the Hardness of Data as a Relational Concept: 

ALL DATA 



ROCK 



MELON 



ROCK 



MELON 



MUSH 



ROCK 



MELON 
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MUSH 



MUSH 



ROCK 



MELON 



MUSH 



TYPE I 

HEURISTIC RESEARCH 



TYPE II 

EDUCATIONAL DECISION-MAKING 



u ill 



EDUCATIONAL AND POLICY 
DECISION-MAKING 



Ntxlol C 

I. Seek answers to following questions: 

1. What kind of materials should be included? 

a. Teacher Training materials only? 

b. Non-Text materials only? 

c. Materials tliat require trainee to perform? 

2. What is the purpose of the Storehouse? 

a. To provide user with a resource for iirprcving his 
performance? 

b. To supply a research with material to employ in his 
investigation? 

c. To collect infonnation for help in policy decisions? 

d. To devellp inventory of materials? 

3. Whore sliould Storehouse be located? 

a. a central depository 

b. a central depository with regional locations 

c. regional locations 

d. no specific location but an office witli referral capability 
only 

4* Hav would the Storehouse be supported? 
a. Federal support 

b* Federal support and private support 

c. Private support 

d. Self-supporting 

e. Other 



Model C Continued 

I low would Storolwuso ho numagcd? 

a, by toaclvcrs + college typos + rcsoard\ tyi>os? 

b. by NliA, AACrili, AJiRA, ASCD, AFT, ATI; and otJior organizations 
Other ways 

6* What categories of organization will allow user to enter the 
storehouse? 

A* Category I - Levels of Evidence by Results 

1. paper pencil test 

2. verbalize or write what one learned 

3. perform in similated situation 

4. perfonn in classroom situation 

5. short-term results with stuients 

6. lasting (long-tem) results with students 

7. other 

B. Category II - Subject Areas 

1. English 

2. Math 

3. Other (including Special Education ^ Early Childhood) 

4. Generic 

C. Category III - Teacher Activities 

1. Planning 

2. Questioning 

3. Diagnosing 
4# Many ncre 

D. Category IV - Setting 
1, Urban 

o 
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Model C Contini^ed 

2, Rural 

3, Othor 

11. Categoxy V - Grade Levels 
!• Primary 

2, Intemediate 

3. Other 

F, Other Categories 
7, Content of each entry 

a. description of material 

b. cost 

c. where available 

d. time for use 

e* source and nature of development 
8* Materials should be "keyed" to other big questions of: 

a. school finance 

b. school policy 

c. social concerns 

d. other 



MODEL D 
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CLASSROOM PRAaiTIONERS 
NON-CLASSROOM PRACTITIONERS 

DISSEMINATION USE 

DEVEUOPMENT USE 



RESEARCH USE 



POLICY USE 



AFFECTIVE 
EVIDENCE 



TESTIMONIAL 
EVIDENCE 



STATISTICAL 
EVIDENCE 



HISTORICAL 
EVIDENCE 



NO 

EVIDENCE 



























1 \ 




\ 


^ 1 

^ 1 



■RJC 



A MANY SOME NO 

THEORY THEORY THEORY THEORY 
BASE BASES BASES BASE 



Modol D Continued 

The f Retire niiyitrates a 120 cell cube v/hicli depiccs a multiple category 
system which would be used to analyze > sort, or describe storehouse 
mtorials, 

•n\o category system would iiave throe dimensions one set oC five 
descriptors of types of evidence » one set of four descriptors o£ 
theoretical bases, and one set of descriptors of user categories. 
The last would be subdivided into multiple user-detemined subcategories. 

Evidence Descriptors 

The descriptors related to evidence deal with the type of evidence which 

supports the material* They are: 

Has Affective Evidence: "I lite it/' 

*'It had a positive effect on mo.^' 
"It was lousy." 

Has restimonial Evidence: "We did it and it woi*ks.*f 

"It had no visible effect." 
"Ohly three teachers are now using it." 

Has Statistical Evidence: "A statistical random sample...." 

.0001" 

Has Historical (Judgmental 
Philosophical, Tlieoretical) 

Evidence: "According to NIE, " 

"For 100 years, " 

Has No Evidence: 0 

Th ooretical Catego/ies 

It is conceivable that if one could name the various theories currently^ 
supporting teacher training material one could establish a set of des- 
criptors accordingly. Until such is possible, a four part category 

system miglU be usable; 



Model D Continued 

tins a Theoretical Basej 
Has 'theoretical Bases: 
Has Scane Theoretical Base: 
lias No n^eorotical Rase: 

User Categories 

These categories are basically undetermined. They will name as the 
descriptors those which will be used to extract infonnation sAd material 
from the Storehouse. The categories will be detemined by surveying of 
a particular group of users as to ''what kind of information or material 
tliey need?", '"what questions will they ask of the Storehouse?", "What 

?" While any category of "User" could form a group to be surveyed^ 

at least six can be readily identified: 

a. polic)' makers 

b. research users 

c. developer users 

d. dissemjjiation »isers 

e. non-classroom practitioners 

f. classroom practitioners 
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Su bject 

Trainiivft odvwiv- 
liomjJ porHonnol 



ToadUng students 




avliuinisitrators 

coiu\solovs 

toachovs 

reading 

independence study 
value clarification 



i 



User condems 

1) clinical concerns 

2) research 

3) materials development 

4) notions and ideas about 
education 



Criteiia 



Wt rol Matrix 
Possible use: Policy R5t) 
Uvideuco : Has 



lesson units that work 
ti spccitV pu;nl outcome 
at particular level 



Theory 
Support 



Sound 



V. 



Practitioners 
None 

None 



yo del F 

TUR NATT o^gAfi fiTnUF.HOUf.r: O F rPUCATIO KM. MATHR I Al.P/SUCCRSSES ; 
KVir)Kn';t' ; NRp nEn tor POriTCY- M^KING/I>POGHAM DUILDING 

•--D^flno lidnl Hvidor/co (Class I Evidence) 

Bot ini.'it'j Domand/Nood for Hard Evidonco 

-EstiriiiLc Availability of H&td Evidence 

^*Bstimatc Gaps Between Demand and Availability 

— --Estimato Cost and Time to Fill Gaps 

— •Reconirnond Alternative Strategies for Pilling Gaps 

---Define Loss Hard Evidence (Class II Evidence) -k. 

-—Etc. (Kopeat stops above until supply and demand are equal) 

- — The Uocd to Educate the Public about 
-What evidence is 
-What is available 

-What ir/idr^r.ce professional educators will use and why# 
i»e.i wo. explain and tell them# they don^t lay it on usi 
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SOME SELECTED EXAMPLES OF 
NATIONAL STOREHOUSE COMPONEOTS 
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THS NATIONAL STOREHOUSE OF KDt>SATIONAL MATRRI/ILS/3UQCESSB3 1 
TBACHBR EDUOATION COMPONaff..»STUDIES OF TEACHER EFFSOTIVmSS 



— * 1696 CharACteristlos of the lidst teachers as recocniseil by 
stvUlents (Krat2) 

— I90S First quantitative studies relatinf conpetence of teachers 

to various other characteristics (Merian) 

1930 An analysis of 209 different systems for ratine teachers 
(Barr and Baans) 

— 19U5'U6 Intensive analysis of teacher's role in classroo* 

(Anderson, et, al.) 

— 19148 Survey of investi cations into the Meaaureaient and predictions 

of toaoher effectiveness (Barr) 

79 studies analyzed 

li6 used supervisor's or principal's ratings 
15 used trades in student teachinf 
18 used Measure of chances In pupils 

-— 1951 Assessmnt of socio-eMotional cliuate in leamlnc situations 
(Wlthall) 

7 oateforles of teacher statenents 

— 19$l* Idantlflcation and rsvlev of all «uJor teacher effectiveness 

studies conpleted hetveen 1900 and 19^2 (Horsh and Wilder) 

900 references 
360 ahstractions 
20 predictors of effectiveness identified 

1958 Analysis of 1,000 studies on teacher effectiveness (Mltzel and Omss) 

20 of the studies (2^) Involved actual 
measures of teacher effectiveness 

— i960 Analysis of teacher characteristics (Ryana) 

6,000 teachers in 1700 schools in 1*50 school systems V 

IliECil-S""-"^ 12 laneral "trends" : M§mM: 
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TUCm BPUOATION COMroi«>IT-»3TUDIE3 OF TBAGHKR imOTlVBWISS. Cont, 



1966 JUuOyais of v«rtid b«k*»lor In the olusrocn (Bdlltck) 

h ftmotioaally different lypee of metnlnc cowmnionte* 

teaohers aM etudents 
$ Ceneral rolee for clMsroen }.tnfu«fe gnu 

— 1971-73 SoAToh fo^ VftlUate* teaoker ohartoterletlcs or 

coapetenslea (Reeenehlne and Furat) 

50 stuiULea 

11 naln oharaoterldtlos 

— 1972 Analyaia of atuilent learainc (Jencks) 

';Most teate used to j^aaure atudont learnln ... 
Inaeneltlve to differencea In teaohlnf VehaTlor." 

— 1960-7li Braluative teaching units 

Flanders - social studies/arithmetic 
Sohauts and Nuthall - eleotrioity 
Joyce - social studies 
Noy - literature 

— 197li Exkaustlvo review and assessment of studies of teacker effects 
on students (Dunkin and Blddle) 



THE NATIONAL STOREHOUSE OF BDVCATIONAL MATERIALS/SUCCESSES t 
TEACHER EPUOATIOH COMPONENT* »SOHE BEQINHIWQ RESODRCES/RtrERENCBS 

T««ck«r Trtlninc Products t The Stu^ of the TieU (750)> Oage 

Proteool Kftteritla CutAlog (112) « Florida SEA 

A Qeoerel Catalos of Teaohinf Skilled Turner 

A Cttalofue of Orovth In the Pedacoiloel Domain, Hudflna 

The Houston Kodule Bank {22$), University of Houston 

HIS R&D Center Produots (eet. 100) 

Far Vfost Lahoratory Mini Courses (20), Berliner, Bore, Flanders, Ward 

Validated Teaoher Characteristics or Donpetenoles/Process Varlahles 
(U), Rosenshlne and Furst 

Critical Elements In Teaohlnt (li2), Crulckshank 

Sharlnf Educational Suocesses — ESEA Title I 

Sharinc Eduoatdonal Successes ESEA Title III 

Tested Modules in Cenpetenoy •Based Education (goocol), 120 CBB IBS's 

Data on Teachlnf and Leamirii In Theses and Dissertations 
in Sduoatlon and Related Fields ((ooeol-plex) 

^)fuid»er in parens Indicates approxlnate nuMWr of products included 



BEST COPY AVAILABLE 



-26 



THE NM'IONAL STOREHOUS E OF EDUCATIONAL MATKRIALS/SUCCES SES i 
TEACHER l:i)UCATlON COMPONENT — SOME BEGINNING REFERENCES 
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THE NATIONAL STOREHOUSE OF EDUCATION AL 
MATERIALS/SUCCESSES} PHOFILE OF 
SOME POTENTIAL EXPERIENCE BASES 

1. 18,000 school districts 

700 "comnmnity" schools 

325 schools using individualized instruction 
4/500 teaching centers 
X alternative schools 

2. '30 states 

20 CBE mandates 

9 career education mandates 

4 teacher center mandates 

3. 1^200 teacher training institutions 

120 programs 
x*^teacher centers 
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SOH.E_J_NTrPrST[Na fACTS 

1. Many powerful educational policy-makers do not think that it 
exists. 

2. Many educators feel that it is already too bountiful and needs no 
further $ for development 

3. Many fool that ERIC has the Storehouse well under control 

4. Storehouse materials with less validation sell faster 

5. Host new validated materials are either on a shelf somewhere 
or used In a single classroom or program 

6. Most consumers do not like to go to some "other" place to use . 
catalogs re materials banks/resources—they want them located 
somewhere in their office 

7. The newsletter Is one of the highest demand consumer items in 
tlic dissemination business 

6. There is a very thin market for many of the most important wateriaU 
developed 

9, flcgardln'j product validation— what might be hard evidence to one 
kind of consumor, is irush to another kindl 

10. Many validated approaches are born In theses and dissertations-- 
and eventually die there 

11. Most producers are reluctant to share materials (a) which are 
unvalidatedi (b) which night be plagarized or copyrighted by loftieone 
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1?, rub1i:;licrs are reluctant to produce high risk materials 

13. AM i»o(!ucrrs are potential consumers and all consumers are poten 
tial producers 

14. CoUcfy: end \inivcrsity staff generally feel that they are the 
only oiics sufficiently qualified :o produce valid materials 

for wiccsprcod use—school staff generally feel that college 
and university staff generally don't know enough about the real 
*/orl(i to produce valid materials. 

15. Materials in the process of "becoming" are usuelly more related 
to "up frbnt" ROAD people than those that have "already bccomo"— 
yet dissemination strategies almost always relate to "finished 
products." 



